Papers with Similarity matching
SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval (2023.acl-long)
Copied to clipboard
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang, Rangan Majumder, Furu Wei
| Challenge: | SimLM uses a simple bottleneck architecture that learns to compress the passage information into a dense vector through self-supervised pre-training. |
| Approach: | They propose a simple yet effective pre-training method for dense passage retrieval that learns to compress the passage information into a dense vector through self-supervised pre-tuning. |
| Outcome: | The proposed method outperforms multi-vector approaches on large-scale passage retrieval datasets and shows significant improvements over baselines. |